2 links tagged with all of: artificial analysis + benchmark
Click any tag below to further narrow down your results
Links
This is Artificial Analysis's leaderboard page for HealthBench Professional, OpenAI's set of 525 clinician conversations graded against physician-written rubrics. It ranks models on length-adjusted score, cost, token use, and speed.
- HealthBench Professional covers consult, writing, and research use cases, including red-teaming and difficult conversations, and is graded with GPT-5.4 (low) across 4 repeats per task.
- The length-adjusted score penalizes answers by 1.47 points per 500 characters above 2,000 and rewards the same amount for shorter ones, matching OpenAI's reported method.
- Claude Fable 5.2 (Xhigh, Default Fallback) currently tops the board at a 68.1% length-adjusted score among models with published results.
+ healthbench professional
artificial analysis
+ healthbench
+ openai
+ medical evaluation
benchmark
This is a leaderboard page for MLCR-AA, Artificial Analysis's version of Wisedocs' open benchmark, which tests whether models can reason across long, fragmented medical records the way insurance claims reviewers do. The top model, Claude Fable 5.2, scores a 43.9% pass rate on the hardest question tiers.
- Each case is a synthetic medical record of roughly 25,000 to 64,000 tokens, and questions are drawn from the two hardest of six difficulty tiers.
- A panel of three LLM judges grades each answer against expert ground truth and the source record; a response passes only if a majority find it complete and free of contradictions.
- Empty responses count as failures, and the score is standalone, not part of the Intelligence Index.